Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Segment Replication][Testing] Creating new Segment Replication client to support running Integ Tests with Segment Replication enabled #9242

Closed
wants to merge 350 commits into from
Closed

[Segment Replication][Testing] Creating new Segment Replication client to support running Integ Tests with Segment Replication enabled #9242

wants to merge 350 commits into from

Conversation

Rishikesh1159
Copy link
Member

@Rishikesh1159 Rishikesh1159 commented Aug 10, 2023 •
edited
Loading

Description

This PR creates new Segment Replication client to support running Integ Tests with Segment Replication enabled.

As we are merging this PR to feature branch/segment_replication, I have hard coded the preference to primary shard in MultiGetShardRequest, MultiGetRequest, GetRequest. Once #8536 is closed we can remove this hard coding of preference to primary in feature branch.

Related Issues

Resolves #8925

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@opensearch-trigger-bot
Copy link
Contributor

Compatibility status:



> Task :checkCompatibility
Incompatible components: [https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer.git]
Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]

BUILD SUCCESSFUL in 33m 5s

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@opensearch-trigger-bot
Copy link
Contributor

Compatibility status:


> Task :checkCompatibility
Checking compatibility for: https://github.com/opensearch-project/reporting.git with ref: main
Incompatible components: [https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/performance-analyzer.git]
Compatible components: [https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git]

BUILD SUCCESSFUL in 32m 35s

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@opensearch-trigger-bot
Copy link
Contributor

Compatibility status:



> Task :checkCompatibility
Incompatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/neural-search.git]
Compatible components: [https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git]

BUILD SUCCESSFUL in 24m 37s

reta and others added 21 commits December 11, 2023 12:52
@reta
Restore support for Java 8 for RestClient (opensearch-project#11562)
4e72741 
Signed-off-by: Andriy Redko <[email protected]>
@mch2
Exclude apache avro version included with hadoop-minicluster (opensea…
cc38e6b 
…rch-project#11564)

Signed-off-by: Marc Handalian <[email protected]>
@mch2
Bump grgit-core ffrom 5.2.0 to 5.2.1 (opensearch-project#11565)
a2f792d 
Signed-off-by: Marc Handalian <[email protected]>
@dependabot
Bump actions/stale from 8 to 9 (opensearch-project#11557)
2798114 
* Bump actions/stale from 8 to 9

Bumps [actions/stale](https://github.com/actions/stale) from 8 to 9.
- [Release notes](https://github.com/actions/stale/releases)
- [Changelog](https://github.com/actions/stale/blob/main/CHANGELOG.md)
- [Commits](actions/stale@v8...v9)

---
updated-dependencies:
- dependency-name: actions/stale
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
@cwperks
Create separate transport action for render search template action (o…
66d4e9e 
…pensearch-project#11170)

Signed-off-by: Craig Perkins <[email protected]>
@mgodwan
Move RAM Usage to precomputed block (opensearch-project#11587)
b5700b4 
Signed-off-by: mgodwan <[email protected]>
@heyanlong
Automatically add scheme to discovery.ec2.endpoint (opensearch-projec…
a8da66c 
…t#11512)

Signed-off-by: Yanlong He <[email protected]>
Signed-off-by: 何延龙 <[email protected]>
@mch2
Add release notes for 1.3.14 (opensearch-project#11592) (opensearch-p…
79b1b74 
…roject#11594)

* Add release notes for 1.3.14



* Add missing bug fixes to release notes



---------

Signed-off-by: Marc Handalian <[email protected]>
@jed326
Add heuristic slice_size for slice level top buckets in concurrent se…
074bc6a 
…gment search (opensearch-project#11585)

Signed-off-by: Jay Deng <[email protected]>
@mch2
Convert issue and bug templates to use forms (opensearch-project#11534)
bb67196 
Signed-off-by: Marc Handalian <[email protected]>
Signed-off-by: Marc Handalian <[email protected]>
@peternied
Personalize code ownership areas (opensearch-project#11600)
9f42963 
Signed-off-by: Peter Nied <[email protected]>
@mch2
Fix regex in triage.yml to support labels with spaces (opensearch-pro…
49ce678 
…ject#11618)

Signed-off-by: Marc Handalian <[email protected]>
@dhwanilpatel
Fix flaky test of IndexShardTests.testRestoreLocalHistoryFromTranslog…
332f4c5 
…OnPromotion (opensearch-project#11487)

Signed-off-by: Dhwanil Patel <[email protected]>
@dependabot
Bump com.gradle.enterprise from 3.15.1 to 3.16.1 (opensearch-project#…
51cab98 
…11629)

* Bump com.gradle.enterprise from 3.15.1 to 3.16.1

Bumps com.gradle.enterprise from 3.15.1 to 3.16.1.

---
updated-dependencies:
- dependency-name: com.gradle.enterprise
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
@heyanlong
Fix automatic addition of protocol in discovery endpoint (opensearch-…
2b1c9ae 
…project#11612)

* Fix opensearch-project#11609

Signed-off-by: Yanlong He <[email protected]>

* Fix opensearch-project#11609

Signed-off-by: heyanlong <[email protected]>

* Update AwsEc2ServiceImplTests.java

Signed-off-by: 何延龙 <[email protected]>

* spotless

Signed-off-by: heyanlong <[email protected]>

---------

Signed-off-by: Yanlong He <[email protected]>
Signed-off-by: heyanlong <[email protected]>
Signed-off-by: 何延龙 <[email protected]>
@dependabot
Bump com.squareup.okio:okio from 3.6.0 to 3.7.0 in /test/fixtures/hdf…
9146c19 
…s-fixture (opensearch-project#11632)

* Bump com.squareup.okio:okio in /test/fixtures/hdfs-fixture

Bumps [com.squareup.okio:okio](https://github.com/square/okio) from 3.6.0 to 3.7.0.
- [Changelog](https://github.com/square/okio/blob/master/CHANGELOG.md)
- [Commits](square/okio@parent-3.6.0...parent-3.7.0)

---
updated-dependencies:
- dependency-name: com.squareup.okio:okio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
@dependabot
Bump actions/download-artifact from 3 to 4 (opensearch-project#11631)
217c382 
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3 to 4.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](actions/download-artifact@v3...v4)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump com.netflix.nebula.ospackage-base from 11.5.0 to 11.6.0 in /dist…
37dae82 
…ribution/packages (opensearch-project#11630)

* Bump com.netflix.nebula.ospackage-base in /distribution/packages

Bumps com.netflix.nebula.ospackage-base from 11.5.0 to 11.6.0.

---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage-base
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
@cwperks
Add additional handling in SearchTemplateRequest when simulate is set…
863d453 
… to true (opensearch-project#11591)

Signed-off-by: Craig Perkins <[email protected]>
@peternied
Bump actions/upload-artifact from 3 to 4 (opensearch-project#11647)
f1243ea 
Signed-off-by: Peter Nied <[email protected]>
@Rishikesh1159
Merge branch 'opensearch-project:main' into segrep-testing-setup
c5f0c34
@github-actions GitHub Actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@opensearch-trigger-bot
Copy link
Contributor

This PR is stalled because it has been open for 30 days with no activity.

@opensearch-trigger-bot opensearch-trigger-bot bot added stalled Issues that have stalled and removed stalled Issues that have stalled labels Jan 19, 2024
@opensearch-trigger-bot
Copy link
Contributor

This PR is stalled because it has been open for 30 days with no activity.

@opensearch-trigger-bot opensearch-trigger-bot bot added stalled Issues that have stalled and removed stalled Issues that have stalled labels Feb 23, 2024
@kotwanikunal
Copy link
Member

Closing this stalled PR. Please reopen to continue with the contribution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@reta reta Awaiting requested review from reta reta is a code owner

@anasalkouz anasalkouz Awaiting requested review from anasalkouz anasalkouz is a code owner

@andrross andrross Awaiting requested review from andrross andrross is a code owner

@Bukhtawar Bukhtawar Awaiting requested review from Bukhtawar Bukhtawar is a code owner

@CEHENKLE CEHENKLE Awaiting requested review from CEHENKLE CEHENKLE is a code owner

@dblock dblock Awaiting requested review from dblock dblock is a code owner

@gbbafna gbbafna Awaiting requested review from gbbafna gbbafna is a code owner

@setiah setiah Awaiting requested review from setiah

@kartg kartg Awaiting requested review from kartg

@kotwanikunal kotwanikunal Awaiting requested review from kotwanikunal kotwanikunal is a code owner

@mch2 mch2 Awaiting requested review from mch2 mch2 is a code owner

@nknize nknize Awaiting requested review from nknize nknize is a code owner

@owaiskazi19 owaiskazi19 Awaiting requested review from owaiskazi19 owaiskazi19 is a code owner

@ryanbogan ryanbogan Awaiting requested review from ryanbogan

@saratvemulapalli saratvemulapalli Awaiting requested review from saratvemulapalli saratvemulapalli is a code owner

@shwetathareja shwetathareja Awaiting requested review from shwetathareja shwetathareja is a code owner

@dreamer-89 dreamer-89 Awaiting requested review from dreamer-89 dreamer-89 is a code owner

@tlfeng tlfeng Awaiting requested review from tlfeng tlfeng is a code owner

@VachaShah VachaShah Awaiting requested review from VachaShah VachaShah is a code owner

@dbwiddis dbwiddis Awaiting requested review from dbwiddis dbwiddis is a code owner

@sachinpkale sachinpkale Awaiting requested review from sachinpkale sachinpkale is a code owner

@sohami sohami Awaiting requested review from sohami sohami is a code owner

@msfroh msfroh Awaiting requested review from msfroh msfroh is a code owner

@peternied peternied Awaiting requested review from peternied peternied is a code owner

Assignees
No one assigned
Labels
distributed framework Indexing:Replication Issues and PRs related to core replication framework eg segrep skip-changelog
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.